Optimal 2-D hierarchical content-based mesh design and update for object-based video

-Representation of video objects using hierarchical 2D content-based meshes for accurate tracking and level of detail (LOD) rendering have been previously proposed, where a simple suboptimal hierarchical mesh design algorithm was employed. However, it was concluded that the performance of the tracking and rendering very much depends on how well each level of the hierarchical mesh structure fits the video object under consideration. To this effect, this paper proposes an optimized design of hierarchical 2D content-based meshes with a shape-adaptive simplification and temporal update mechanism for object based video. Particular contributions of this work are: i) Analysis of optimal number of nodes for the initial fine level-of-detail mesh design, ii) Adaptive shape simplification across hierarchy levels, iii) Optimization of the interior node decimation method to remove only a maximal independent set to preserve Delaunay topology across hierarchy levels for better bitrate versus quality performance and iv) A mesh update mechanism which serves to update temporally 2D dynamic mesh in case of occlusion due to 3D motion and self-occlusion. The proposed optimized and temporally updated hierarchical mesh representation can be applied in object-based video coding, retrieval and manipulation. Index Terms --Object-based video, MPEG-4, 2-D dynamic mesh, hierarchical mesh, scalability, Delaunay triangulation, maximal independent set, dynamic programming, occlusion, mesh update Optimal 2D Hierarchical Content-Based Mesh Design and Update for Object-Based Video Işıl Celasun, Member, IEEE and A. Murat Tekalp, Senior Member,IEEE